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ABSTRACT 

We consider the problem of learned navigation of a circular robot R , of radius 8 (>0), through a 
terrain whose model is not a priori known. We consider two-dimensional finite-sized terrains popu- 
lated by an unknown (but, finite) number of simple polygonal obstacles. The number and locations of 
the vertices of each obstacle are unknown to R . R is equipped with a sensor system that detects all 
vertices and edges that are visible from its present location. In this context we deal with two prob- 
lems. In the visit problem, the robot is required to visit a sequence of destination points, and in the 
terrain model acquisition problem, the robot is required to acquire the complete model of the terrain. 
We present an algorithmic framework for solving these two problems using a retraction of the free- 
space onto the Voronoi diagram of the terrain. We then present algorithms to solve the visit problem 
and the terrain model acquisition problem. 

1. INTRODUCTION 

We consider the problem of the collision-free navigation of a circular robot through an unknown 
terrain, i.e., a terrain whose model is not a priori known. Several variants of this problem have been 
investigated. An algorithm for a point robot to escape out of a maze using touch sensing ability is 
given in [1], In [6], algorithms for a point robot to move from a source point to a destination point 
using touch sensing are presented. The algorithms that enable a point robot to navigate to a destina- 
tion point, and at the same time "learn" about the parts of terrain that are encountered on the way to 
the destination are presented in [2,7]. This process of learning is termed as incidental learning. Here 
the robot uses a combination of touch sensing and distance probing. The same problem is also solved 
in the case where the point robot is equipped with a sensor that obtains all the visible obstacle boun- 
daries [8]. The above problems can be grouped under a generic name of the visit problem, wherein a 
robot is required to visit a sequence of destination points through an unknown terrain. Another prob- 
lem, called the terrain model acquisition problem, wherein a point robot is required to acquire the 
complete model of the terrain is also studied [10]. The solutions of [7,8,10] are based on an incre- 
mental construction of the visibility graph of the terrain. The above problems have to be dis- 
tinguished from those that deal with the navigation in known terrains, i.e. the terrains whose models 
are available. A comprehensive treatment of these problems can be found in [11]. 

These formulations of the navigational problem are motivated by a practical application involv- 
ing the development of an autonomous rescue robot. This robot is intended for carrying out rescue 
operations in nuclear power plants in the events of radiation leakages, and other incidents that prevent 
human operation. A solution to the visit problem helps in developing a robot that can carry out a set 
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of operations in different locations in unfamiliar environments. Since the motion planning here is 
essentially sensor-based, the navigation involves expensive sensor operations. Further more, the robot 
could temporarily navigate into local detours because of the partial nature of the information returned 
by the sensors. By incorporating the incidental learning feature, we reduce the expected number of 
sensor operations, and the expected number of detours, as the robot visits newer locations. Instead, if 
the complete terrain model is available, the robot can avoid the local detours, and also avoid the 
expensive sensor operations. Thus a solution to the terrain model acquisition problem helps the robot 
in acquiring the terrain model during the period in between the rescue operations. A dedicated rescue 
robot typically idles in between two successive rescue operations, and the rescue operations could be 
fairly infrequent. In such cases, the resources are better utilized if the robot is employed in the terrain 
model acquisition process during this period. The proposed methodology in solving these navigational 
problems provides a basic algorithmic framework that aids the design of a navigational system for the 
abovementioned rescue robot. The same methodology can also aid the development of navigational 
systems for other autonomous mobile machines in applications such as space navigation, underwater 
explorations, maintenance of space laboratories etc. However, a practical implementation of the pro- 
posed system calls for advances in more general theoretical aspects as well as several other issues 
such as sensing and movement errors, etc., which are not discussed in the above works as well as in 
this paper. 

The visit problem and the terrain model acquisition problem have been solved separately 
[7,8,10]. In this paper, we present a unified framework for solving both the problems using a method 
based on a retraction of free-space onto the Voronoi diagram of the terrain. In this framework, we 
use the single approach of implementing a graph search algorithm on a graph, called the navigational 
course. We deal with a circular robot as opposed to the point robot of earlier works. Moreover, this 
method has an advantage of keeping the robot as far away from the obstacles as possible. This aspect 
seems very important in practical implementations as the earlier methods, based on the visibility graph 
methods, may require that the robot navigate along the obstacle boundaries. Additionally, the pro- 
posed method results in a storage complexity of O(N) as opposed to 0(N 2 ) of visibility graph based 
methods [7,10], Also, this method results in a path-planning complexity of O (N^IlogN ), whereas the 
visibility graph method has a complexity of 0(N 3 ) for the same. In this paper, we present briefly 
present our results and the details can be found in our report [9]. 

The organization of the paper is as follows: The basic framework of our solution is outlined in 
Section 2. In Section 3, we present the definition and properties of the navigation course to be used 
for navigational purposes. In Section 4, we first present solutions for the visit problem, and the ter- 
rain model acquisition problem. 

2. BASIC ALGORITHM 

We first describe the problem scenario and then present the basic algorithm used in the solution 
of the visit problem and the terrain model acquisition problem. 

Terrain: We consider a finite-sized two-dimensional terrain populated by a finite set 
0={0 U 0 2 , ■ O n } (n is finite) of simple disjoint polygons, called the obstacles. Each obstacle O t 
has a finite number of vertices. The terrain in completely unknown to R , i.e., the number of obsta- 
cles, and also the number and locations of vertices of each obstacle are unknown to R . The free- 

n 

space is given by Q=(~)0, c , where <9, c is the complement of <9, in the plane. The closure of the 
i=l 

free-space is denoted by Q. Let N denote the total number of vertices of all obstacles. Let VER ((9, ) 
denote the set of vertices of <9, . 
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Robot: We consider a circular body R of radius 8, (8^0). The location of the center of R is called 
the position of R . We treat R as an open disc of radius 6 centered at the position of R. R houses a 
computational device with storage capability. Also, R is capable of moving along a straight-line path 
or a curved path of second degree (in each case the path is specified). R takes a finite amount of time 
to move through a finite amount of distance. Further, R is equipped with an algorithm B that plans a 
collision-free path (for R) through a known terrain. In particular, we can use a suitable algorithm 
from [11] for this purpose. 

Sensor System: Let x be a position of R . A point y e ft is said to be visible to R if the straight line 
joining x and y is entirely contained in ft. R is equipped with a sensor that detects the maximal set 
of points on the obstacle boundaries that are visible from its present location. Such an operation is 
termed as the scan operation. We assume that the scan operation is precise and error-free. 

Two Navigational Problems 

Initially, R is located at a point d 0 without intersecting any obstacle polygons and at a finite dis- 
tance from an obstacle. In the terrain model acquisition problem, R is required to acquire the model 
of the terrain to a degree such that it can navigate to any reachable destination location by planning a 
path using the known terrain algorithm B alone. If a destination position is not reachable then R 
should report this fact without performing sensor operations. Note that after the terrain model is com- 
pletely acquired, no sensor operations are needed for navigational purposes. Second, in the visit prob- 
lem, R is required to visit the points d l ,d 2 , ■ • ■ ,d N in the specified order if there exists a path 
through these points. If no such path exists, then R must report this fact in a finite amount of time. 

Navigation strategy 

We now present the algorithm NAV which is the basic underlying strategy used by R to solve 
the visit problem and the terrain model acquisition problem. Here, R performs a "graph exploration 
type” of navigation using a combinatorial graph called the navigation course, £(0 ), of the terrain O . 
%{0) is a 1 -skeleton embedded in ft. The nodes (edges) of £(<?) are called £-nodes (%-edges). Each 
£-node specifies a collision-free position for R , i.e. a position for R such that it is entirely contained 
in ft. An edge that joins two x -nodes vj and v 2 specifies a collision-free path, of finite length, from 
vj to v 2 for R . The £(0) is initially unknown and it is incrementally constructed using the data 
obtained through the sensor operations. The algorithm NAV is given below: 

Consider the execution of NAV by R. NAV in initiated with a ^-vertex v=v 0 and S 2 ={v 0 }. The 
set S i contains all the ^-vertices that are visited by R . The set S 2 contains all the ^-vertices that not 
visited by R , but each veS 2 is adjacent to some ^-vertex in Sj. R keeps visiting new £; -vertices until 
the set 5 2 becomes empty. When R visits v for the first time the adjacency list of v is computed. In 
this way, the £((9 ) is incrementally constructed. The scan operation of line 1 and the computational 
operations in lines 2-7 and 11-12 can be directly executed by R . The path planning of line 8 involves 
finding a graph path from v to v* . R actually moves along the edges of the computed path in line 9. 

S i forms a connected (graph) component with the edge set being the set of all edges that are 
traversed by R. Further 5 ju 5 2 forms a connected (graph) component with the edge set being the 
union of the set of all edges traversed by R and the set of all edges computed by R . Thus there 
exists a path along the edges (of the component) from any vertex of .$! to any vertex of S 2 . In each 
step, R , located at v, selects a v* eS 2 , and then it moves to v*. In this aspect, NAV is similar to a 
standard graph exploration algorithm except for one difference. In a graph algorithm the cost associ- 
ated with accessing the node v* (after it is chosen) is a single memory access. In NAV, when R 
accesses v* there are two associated costs: (a) the computational cost of planning a path from v to v 
(b) the cost of moving R along the computed path. 
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algorithm NAV(v ); 
begin 

1 . perform a scan operation from v ; 

2. mark v as visited and delete it from S 2 and append to 

3. compute the adjacency list of v ; 

4. append to S 2 all neighbors of v that are not visited; 

5. if (5 2 is not empty) 

6. then 

7. select v*e $ 2 ! 

8. plan a path from v to v * ; 

9. move to v * ; 

10. NAV(v*)\ 

11. else 

12. return to start vertex v 0 ; 

endif 

end; 


In order to yield correct solutions to the visit problem and the terrain model acquisition problem, 
the navigational course £(0) has to satisfy a set of properties. These properties for the proposed 
Q(0 ) are discussed in detail in the next section. Suppose that %{0 ) satisfies the property of local- 
constructibility, i.e., the adjacency list of a ^-vertex v can be computed from the information obtained 
by a scan operation performed from v. Further, suppose that £(0) satisfies finiteness property, i.e., 
£((?) has finite number of vertices. Also let £(0) satisfy graph connectivity property, i.e., any two £- 
vertices are connected by a path of ^-edges. Then we have the following observation. 

Observation 1: If £(0) satisfies the properties of finiteness, connectivity and local-constructibility, 
then, R , executing the algorithm NAV , visits all vertices of%{0 ) in a finite amount of time. □ 

3. THE NAVIGATIONAL COURSE 

We first present a structure that yields a navigational course to be used by a point robot. We 
then extend our discussion to a circular robot. 

3.1. Point Robot 

For xgO, we define Near(x) as the set of points that belong to the boundaries of obstacles <9,, 
i=l>2, ■ ■ ,n and are closest to x. The Voronoi diagram, Vor(O), of the terrain populated by 0 is 

the set of points: 

{xe Q.\Near(x) contains more than one point } 

In this case, Vor(0) is a union of 0(N) straight lines and parabolic arcs (see [4,5] for more details). 
Each of this line or parabolic arc is referred to as V-edge. The points at which the edges meet are 
called V-vertices. Furthermore, Vor(O) can be specified as a combinatorial graph in which each edge 
is labeled with two end V-vertices, and an equation defining it as a curve in the plane. Each V-vertex 
is labeled with its coordinates. 

Consider the convex hull C(0) of union of vertices of all obstacles (i.e. convex hull of 

n 

KjVER(Oi)). Let E(0) denote the polygonal region obtained by pushing the edges of C(0 ) out- 
let 
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Figure 1. The Vor,(0) for the terrain 0={0 1 ,0 2 ,0 3 }. 
wards by a distance of s and taking die interior of ‘grown’ region. Let us define 
Vor } (0 )=(Vor (Q.)nE (O ))udE (O ), where dE(O) is the boundary of E {O ). We note that Vor : (0) 
precisely contains the Voronoi diagram of O that lies inside E(0) and the boundary of E {O ). The 
edges (vertices) of Vor x {0 ) are called V ] -edges (V i-vertices). See Fig. 1 for an example. The set of 
vertices of Vor i(0 ) is the union of V -vertices, vertices of the envelop E{0) and intersection points of 
edges of dE(0) with V-edges. Similarly the set of edges of Vor x (0 ) is the union of edges of 
Vor(O) that are contained in E(O) and the edges of 3 E(O). It is easy to see Vor ) as a planar 
graph formed by V r vertices and Vj-edges. The set of all V ! -vertices that are adjacent to a vertex 
v constitute the set of neighbors of v. The following four basic properties of Vor { (0) are shown in 

[9]: 

(i) Combinatorial properties : The number of V ! -vertices is at most AN—n—2, and the number of V l - 
edges is at most 6N-3n-3. 

(ii) Connectivity: Vor^O ) is topologically connected, and consequently Vor^O) is graph connected 
when viewed as a combinatorial graph i.e., there exist a path along Vj-edges between any two V r 
vertices. 

(iii) Terrain-visibility: Every point in the closure of fiee-space £2 is visible from some V'! -vertex, i.e., 
for xeQ, there exist a V [-vertex v such that the line joining x and v is entirely contained in Q. 

(iv) Local-constructibility: All the neighbors of a V j -vertex v can be correctly computed from the ter- 
rain boundary information obtained by performing a scan operation at v . 

3.2. Circular Robot 

For xe£l, let Clearance (x) denote the distance of x from a member of Near (x) (in terms of the 
Euclidean distance). Consider Vor^{0) such that the distance s used in obtaining E(O) is at least 8. 
Let us consider a subset of Vor^O ) given by (xg Vor x {0 ) | Clearance (x )>8} which is the set of 
points of Vor { (0 ) with clearance greater than 8. This set consists of a set of connected components. 
Initially, let R be located at d 0 e£l. Let Vor* j(<9) be the connected component that contains Im(c/ 0 ), 
i.e., lm (d 0 )e Vor * t (O ). Vor* i(0 ) contains either all or none of the edges of E ( O ). Further an edge 
of Vor* \{0 ) could be a truncated version of an edge of Vor(0), in which case we attach a vertex at 
the truncated end. These vertices are called truncated vertices. The edge formed as a result is called 
the truncated edge. We now summarize the properties of Vor \(0 ). 
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Properties 2: Vor x (0 ) satisfies the properties of finiteness, connectedness, terrain-visibility and 
local-constructibility. 

4. NAVIGATION ALGORITHMS 

We first discuss the navigational course and the navigation strategy used by R . Then we present 
the algorithm ACQUIRE that solves the terrain model acquisition problem. We then present the algo- 
rithm LNAV that navigates R from d t to d ux if a path exists from </,• to d i+l . Then we obtain the 
algorithm GNAV that solves the visit problem. GNAV uses LNAV as a component and also incor- 
porates the feature of incidental learning. 



4.1. Preliminaries 

For a point robot, £(£>) is obtained by deleting from Vor x (0) all the Vj-edges that terminate on 
a concave comer. Such edges are formed by two obstacle edges that meet at a concave comer. For a 
circular robot £,(0) is obtained by deleting from Vor* x (0 ) all the truncated edges. In Fig. 2, we 
show the terrain O ={0 x ,0 2 ,0 2 }, and the corresponding Vor x (0 ). In Fig. 3, we show %(0) for a cir- 
cular robot. Note that every V-edge that terminates at a concave comer generates a truncated edge. 
We assume that the process of deletion of an edge retains the vertex that connects the edge to the rest 
of Vor x (0) or Vor* x (0). Now, view £,(0 ) as 1-skeleton embedded in the plane. It is clear from the 
definition that any point on £,(0 ) - in particular a ^-vertex - specifies a collision-free position for R . 
Consequendy, a 2; -edge specifies a collision-free path for R . It is direct to see that £(<9 ) satisfies the 
properties of finiteness and local-constructibility. The connectivity of £,(0) can be shown by observ- 
ing that each edge that is removed from Vor x (0) and Vor* x (0 ) is pendant and can not disconnect 
resultant set. Let C denote the number of concave comers of the terrain O . Note that we delete (at 
least) C V -edges and V -vertices from Vor x (0) (Vor* x (0 )) for a point (circular) robot. Then we 
have the following properties. 

Properties 3: £,(0 ) for a point or a circular robot satisfies the properties of finiteness, connectivity, 
terrain-visibility and local-constructibility. Further more 
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(i) ^-vertices <AN -n-C -2 

(ii) #^-edges <&N-3n-C-6. □ 



Now consider the execution of the algorithm NAV. For ease of presentation, we discuss a 
depth-first implementation of NAV which specifies a particular way to select v the £ -vertex to be 
visited next (line 7). R is presently located at the ^-vertex v. If v has neighbors that are not visited 
then R chooses one of the unvisited neighbors as v*. If all neighbors of v* are visited then R 
chooses the vertex of S 2 that is reachable by a minimal distance path. This path is obtained by invok- 
ing one-to-all shortest path algorithm of [2] on the presently available £(0) and picking the vertex 
that is reachable from v by a path of minimal length. Note that £(0 ) is a planar graph. Cost of this 
computation is O (N VlogA ). 

4.2. Terrain Model Acquisition 

The algorithm ACQUIRE is a direct implementation of the algorithm NAV . Once the terrain 
model is available one can use the algorithm B to plan a path to reach any destination point This 
algorithm has a time complexity of O(NlogN) [11]. Thus we have the following theorem. 

Theorem 1: The algorithm ACQUIRE solves the terrain model acquisition problem in a finite amount 
of time such that 

(i) The number of scan operations performed is at most AN—n—C—2. 

(ii) The total distance traversed by R while executing ACQUIRE is at most twice the total length 
of the depth-first tree of £(0 ) rooted at v 0 . 

After the execution of ACQUIRE, R can navigate to any reachable destination with a time complexity 
of O (N\ogN ) and with no sensor operations. □ 

In our implementation we use the adjacency list representation of £(0 ). We store the coordi- 
nates of each ^-vertex in the adjacency lists. We maintain a table called MAP-TABLE as an AVL 
tree. The cost of this operation is O (logA) using the table. 

Theorem 2: The complexities of various tasks carried out by ACQUIRE are as follows: 

(i) the storage complexity is O(N), 
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(ii) cost of construction of\(0 ) is O (N 2 \ogN) 

(iii) total cost of path planning is O (A^VlogW ), 

(iv) cost of construction of MAP-TABLE is 0(N\ogN), and total cost of accesses to MAP -TABLE is 
0(N logN). □ 

43. Visit Problem 

We now discuss the algorithm LNAV that navigates R from its present location at d L to a desti- 
nation point d i+l if such path exists. If there is no path from d t to d M , then R will declare the same 
in a finite amount of time. The algorithm LNAV is obtained by modifying NAV . Initially a scan is 
performed from dj and if j is found reachable, then R moves to If is not found reach- 
able then R computes a ^-vertex vq and moves to v q. From vq, the algorithm NAV is invoked. Let 
R be located at v . After a scan is performed from v , R checks if d i+l is reachable. If d i+l is reach- 
able, then R moves to d i+l and terminates NAV. If not, R continues to execute NAV until comple- 
tion. If d, + j is not found after S 2 becomes empty then d, is declared as not reachable. 

Theorem 3: Algorithm LNAV navigates R from d t to d i+l in a finite amount of time if the latter is 
reachable. If d i+l is not reachable then R declares so in a finite amount of time. In executing the 
algorithm LNAV by R , 

(i) the number of scan operations is at most 4N— n— C— 2, 

(ii) the total distance traversed is at most equal to twice the length of the depth first tree of 1,(0 ) 
rooted at v 0 . □ 

The computational complexity of executing the algorithm LNAV follows along the lines of previ- 
ous section. Thus, in executing the algorithm LNAV, (i) the storage required is 0(N), (ii) cost of 
construction of £(0) is 0(N 2 logN), (iii) complexity of path planning is O (N 2 ^l\ogN ) (iv) the cost of 
construction of MAP-TABLE is O(NlogN), and the total cost of accesses to MAP-TABLE is 
0(N\ogN). 



(a) R escaping out of a concavity (b) R moving out of a maze 

Figure 4. Execution of LNAV by R 

In Fig. 4 we show a point robot moving out of a concavity, and moving out of a maze. In Fig. 
5 we show a point robot moving out of a maze with backtracking. We can solve the visit problem by 
a repeated invocation of LNAV . LNAV completely relies on the sensor information for navigation. 
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Since the sensor obtains only a partial information about the terrain, as a result R might navigate into 
local concavities as in Fig. 5. If R is required to navigate in the regions that it navigated in previous 
traversals, then it can use the previous information to plan its present course of navigation. Note that 
the partial model of the terrain depends on the paths traversed by R in earlier traversals. We now 
obtain the algorithm GNAV as follows: We store the adjacency lists computed by R over the traver- 
sals in a global 4(0 ). Further the set S 2 is also stored over the traversals. Consider the navigation 
from di to d i+l . Then GNAV computes a 4-vertex that is reachable from d, and moves to this vertex. 
Then R computes a 4-vertex d* that is closest to d i+l according to some criterion such as distance. 
Then R moves along a path on %(0 ) to d* . From d * , R uses LNAV to navigate to d t+1 . It is direct 
to see that GNAV correctly solves the visit problem. Moreover, R checks the set S 2 after every scan 
operation. After S 2 becomes empty, R switches-off its sensor and navigates the further traversals 
using the algorithm B alone. At this stage R has acquired the terrain model that is sufficient to navi- 
gate to any reachable point. Thus after this stage R does not perform scan operations for the purpose 
of navigation, and also R would avoid local concavities. Using the arguments of previous section it is 
clear that such stage will be reached after at most 4N+M-n-C-l scan operations. Thus we have the 
following theorem. 

Theorem 4: The terrain model will be completely built by R in at most 4N+M—n—C — l scans, then 
the execution of each traversal involves no scan operations with a time complexity of O (N log/V ) □ 




(a) R backtracks once (b) R backtracks twice 

Figure 5. Execution of LNAV by R. 

Since the process by which R acquires the terrain is incidental, i.e., depends on the previous 
traversals it executed, it is possible to make probabilistic statements about the performance of GNAV . 
Let 4(0 )=(V £ ). Let p v (>0) be the probability that R visits a 4-vertex during any traversal. Proba- 
bility that a scan is performed from v in zth traversal is (l-p v )' _1 /V Then the probability that the 
terrain model will be complete during the mission of M traversals if fj[l— (1— p v ) M ] which is non- 

V€ V 

zero. Moreover this probability approaches to 1 as M approaches infinity. Thus in a limiting case R 
obtains the complete terrain model with a probability of one. 
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5. CONCLUSIONS 

We presented an algorithmic framework based on a retraction of free-space to solve two naviga- 
tional problems for a circular robot moving in an unknown terrain. We consider the visit problem in 
which the robot is required to visit a sequence of destination points. We present an algorithm that 
enables the robot to visit the destination points using an ideal sensor, and also build the terrain model 
in the regions it navigates. Further the robot can detect the completion of the terrain model, and at 
this stage it switches to a known terrains navigation algorithm. After this stage, the future navigation 
is carried out without using the sensor. We also consider the terrain model acquisition problem 
wherein the robot is required to autonomously explore the terrain and build a model of the terrain 
such that the future navigation to any reachable destination can be carried out using the algorithms of 
known terrains alone. 
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